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Abstract. - An approach to analyze the performance of the code division multiple access 
(CDMA) scheme, which is a core technology used in modern wireless communication systems, 
is provided. The approach characterizes the objective system by the eigenvalue spectrum of a 
cross-correlation matrix composed of signature sequences used in CDMA communication, which 
enable us to handle a wider class of CDMA systems beyond the basic model reported by Tanaka 
in Europhys. Lett., 54 (2001) 540. The utility of the scheme is shown by analyzing a system 
in which the generation of signature sequences is designed for enhancing the orthogonality. 
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\ Introduction. Over the last decade, the scope of statistical mechanics has rapidly 

■ expanded beyond its original goal of analyzing many-body problems that arise when dealing 
with material objects. Information theory is a major source of problems, and research activity 
aimed at solving these problems is becoming popular. Identifying information bits with Ising 
spins, many problems in information theory, such as error correcting/compression codes [1-10] 
and cryptosystems [11, 12], can be formulated as virtual many-body systems that are subject 
to disordered interactions. Analysis of the formulated problems using techniques of statistical 
mechanics has provided various nontrivial results that have not been obtained by conventional 
methods of information theory [13,14]. 

Code division multiple access (CDMA), which is a core technology used in modern wireless 
communication, is an example of the successful application of such a statistical mechanical 
approach. This technology realizes simultaneous communication between multiple users and 
a single base station by modulating each user's bit signal (symbol) into a sequence of random 
pattern, termed the signature sequence [15]. CDMA has already been employed in third- 
generation mobile phone systems and wireless LANs. 

Tanaka (2001) showed that the replica method of statistical mechanics enables the accurate 
assessment of the communication performance of a basic CDMA model in which users' se- 
quences are generated independently of each other in a large system limit [16,17]. This research 
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was considered to be ground-breaking, and variations of the basic model are currently being 
actively analyzed based on the scheme given by Tanaka [18-21]. However, Tanaka's scheme 
relies on the assumption of statistical independence among users' sequences and, therefore, 
cannot be applied to systems in which sequences are not independent. As certain dependence 
generally arises among sequences when the system is designed for optimizing communication 
performance, this limitation is problematic with respect to practical relevance. 

The purpose of this Letter is to resolve this problem. More precisely, we present another 
approach by which to analytically assess the performance of CDMA communication. The cen- 
tral concept of our scheme is to characterize the objective system by the eigenvalue spectrum 
of the cross-correlation matrix composed of sequences under the assumption that the orthogo- 
nal eigenbasis is randomly provided. The range of applicability of such characterization is not 
clear at the current moment; however, this enables us to analytically handle CDMA systems 
regardless of whether sequences are statistically independent and offers, at least, a useful ap- 
proximation scheme for investigating advanced systems. The utility of the approach is shown 
by analyzing a system that is difficult to assess accurately by the conventional scheme. 

Modeling. - As a general scenario of CDMA systems, let us assume a situation in which 
K users simultaneously transmit symbols 6" = ±1 (k = 1,2, ... , K) to a single base station 
utilizing the sequences of TV-dimensional vectors s& = (s^fc) (/i = 1, 2, . . . , N), where /x indexes 
the chip timing of the symbol modulation and normalization constraint |sjt| = 1 is imposed. 
We denote an N x K matrix composed of and a set of the received amplitudes of users' 
signals as S = (s^) and a diagonal matrix A = diag(Afc), respectively, both of which are 
assumed to be known to the base station. In order to cope with cases in which the sequences 
correlate with each other, we characterize the system by a K x K cross-correlation matrix 
R — A T S T SA, where X T represents the transpose of X, and assume that R can be regarded 



where D is a diagonal matrix D = diag(Z?fc), the eigenvalue spectrum of which, K^ 1 Y)k—i S(X— 
Dfc), is provided as p(X) and a K x K orthogonal matrix O is assumed to be drawn randomly 
from the uniform distribution defined by the Haar measure on the orthogonal group [22]. Such 
characterization is supposed to be plausible because for a wide class of systems R becomes 
dense and the sequences are generated in a somewhat random manner, which statistically pro- 
duces no preferential direction, although mathematical validity of assuming Eq. {1} should be 
examined in future research. Under the additional simplifying assumptions that the channel 
noise is the additive white Gaussian of variance <7q an d both the chip timing and symbol 
timing are synchronous across all users, the received signals at base station, r = (r^), can be 
represented as 



where 6° = and rj is an A^-dimensional random vector, each component of which is 
generated independently from the normal distribution Af(0, 1). 

After receiving r, the remaining task of the base station is to infer the users' original 
symbols which is called user detection or demodulation. The optimal demodulation scheme 
to minimize the bit-wise probability of incorrect estimation, which is referred to as the bit 
error rate Pf,, is provided by using the posterior distribution 



as 



R=ODO 



-i 



(1) 



r = SAb + aorj, 



(2) 



P(b\r) = Z' 1 exp -— j T (r- SAbf(r- SAb) 



(3) 
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as bk = sign bkP(b\r)^ when the assumed noise variance a 2 is in accordance with the 
correct value erg. Here, Z = £ b exp H r _ SAb) T (r - SAb)/(2a 2 )} serves as the partition 
function, bk denotes the estimate of the fcth user's symbol 6" and sign(u) = u/\u\ for u ^ 0. 

Analysis. Since Eq. ([3]) is conditioned by the predetermined random variable r = 
SAb a + croT], we resort to the replica method to assess the typical performance of the CDMA 
system assuming a large system limit A, N — * oo while maintaining the load [3 — K/N . 
Namely, we evaluate the n(= 1,2,.. .)th moment of the partition function Z with respect to 
the relevant predetermined randomness and analytically continue the obtained expression to 
real n e R. For this purpose, it is convenient to first take the average with respect to r], which 
provides 



Drj exp 



n 

. — J2(r-SAb a f(r-SAb a ) 







— exp 


-TtRL(n) 

2 v _ 



(4) 



where b a is the ath replica of symbol vector b, D-q = (27r) n ^ 2 exp [— | *7 1 2 / 2] and 



L(n) = -±- 2 j2{b°-b a )(b°-b*) T 



a 2 {a 2 + na 2 ) 




(5) 



Equation (JTJ indicates that the average of Eq. Q with respect to the cross-correlation matrix 
R is reduced to a form of 



VR exp 



-TiRL(n) 

2 v ; 



exp 



KTrG 



L(n) 
K 



(6) 



for large K, where a function G[x) is provided by the eigenvalue spectrum p(\) as G[x) — 
(1/2) L dt (A(<) — utilizing a function A(x) that is implicitly determined by the condi- 
tion [22,23] 



x = / d\p(X)(A(x) - A)" 



(7) 



For a given G- function, G(x) 1 Eq. ([7]) (Cauchy transform) can also be utilized to assess x as 
a function of A. The function x(A) is directly linked to the spectrum by Stieltjes inversion 
formula, 



p(X) = lim — Im x(X 



— Im x(X — ■</— Te). 



(8) 



Intrinsic permutation symmetry among replicas naturally leads to the replica symmetric 
(RS) ansatz, implying that configurations characterized by b° ■ b a = Km (a = 1,2, ...,n) 
and b a ■ b b = Kq (a > b) provide the most dominant contribution to the moment evaluation. 
Under this ansatz, the K x K matrix L(n) has three types of eigenvalues: Ai = —K(a 2 + 
n(To) _1 (l — q + n(l — 2m + q)), A2 = — AV~ 2 (1 — q) and A3 = 0, the numbers of degeneracy 
of which are 1, n — 1 and K — n, respectively. This indicates that Eq. ([6]) is evaluated as 



exp 



K G - 



1- q + n(l-2m + q)\ ( l-q 
+ (n-l)G -5- 



(9) 
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Continuing both of this and the RS entropic contribution of Tr^i ^2 ^™ H"=i ^(^° ' — 

Km) Yl a>b S(b a ■ b b — Kq) analytically from n = 1, 2, ... to real values, n g R, provides an 
expression of the average free energy 



— In Z = lim mi?" 

K n^o nK 



Extr 



-mm - ^ + y L>z In (2 cosh y^z + mH , (10) 

where Dz — (2n)~ 1 / 2 dz exp [— z 2 /2\ , Extr„{- • •} indicates the extremization of {• • •} with 
respect to u, and (• • •) denotes the average of (• • •) with respect to t] and R. Equation (flO|) is 
the main result of the present letter. 

Three things are noteworthy here. First, the bit error rate Pb can be assessed as Pb = 
im/i/i by utilizing the values of the conjugate variables q and m that extremize Eq. 
(fTUl) . This implies that Eqs. ((7| and (fT0|) offer a complete scheme for assessing the typical 
communication performance of CDMA systems characterized by the eigenvalue spectrum p(A). 
Second, the basic model analyzed in [16] can be characterized by p(A) = Pbasic(A) = [1 — 

/3- 1 ]+ ( 5(A) + (27T/3A)- 1 ^[A - (1 - V^) 2 ] + [(1 + VP) 2 - A] + , where [u]+ = u for u > and 0, 
otherwise. This yields G(x) — Gbasic(^) = — (2/3) -1 ln(l — j3x), which, when inserted into Eq. 
(fTU|) . reproduces an expression equivalent to the free energy of [16] (Eq. (10) in [16]). Namely, 
the conventional analysis is one component of our formalism. Finally, although thus far we 
have assumed the RS ansatz, the local stability of the RS solution can be broken when the 
assumed noise variance a 2 is set sufficiently smaller than the correct value a 2 . The stability 
condition with respect to the local perturbation of breaking the replica symmetry can be 
examined via the de Almeida-Thouless analysis [24], which, in the current case, yields the 
following expression: 

1 - Jl G '' (-^r) J Dz (l- tank 2 (y^z + m)^ 2 > 0. (11) 

A similar result was reported in [23]. 

Computationally feasible demodulation algorithm. - Although the above mentioned pro- 
cedure provides the typical performance of the estimator bk — sign (J2b bkP{b\r)) , perform- 
ing the procedure exactly for a given received signal r is computationally difficult in the 
general case. Advanced mean field methods of the Thouless- Anderson-Palmer (TAP) type 
have recently been receiving attention as promising approaches by which to resolve this diffi- 
culty [25,26]. For the basic models, one can construct a computationally feasible demodulation 
algorithm along this line by using the property of statistical independence of sequences [27]. 
Unfortunately, this strategy is not available in the present case. Nevertheless, one can con- 
struct such a heuristic algorithm that coincides with the result for the basic model when p(A) 
is set to pbasic(A). Denoting the approximate symbol average J^b bkP{b\r) at the tth update 
as ml. — tanh(/ii), we obtain 



= 2G'{- 



1 < 



h* = A T S T at + £G>(-^) 



b (r - SAmt) + , i -la 



2G' 



m*- 1 , 



(12) 
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Fig. 1 - Schematic diagrams of eigenvalue spectra for (a) the current example system of J3\ = 1, 
= — 1 > and /3fc = Vfc > 3 and (b) the basic model of [16], in which the component of 
the sequences, s^, is provided as +N' 1 ^ 2 or —N^ 1 ^ 2 with an equal probability independently of a 
pair of indices /i, k. Amplitudes Ak are set to unity Vfc in both systems. Even in the basic model, 
a randomly drawn pair of sequences, Si and Sj, is regarded as almost orthogonal for large N since 
the overlap Si ■ typically vanishes as 0(N~ 1 ^ 2 ) as iV — > oo. However, the constraint of perfect 
orthogonality within an identical group that is imposed in the example system makes the feature of 
the eigenvalue spectrum p(X), which is composed of three delta-peaks at A = 0, 1 and 2, considerably 
different from that of pbasic(A), which is made up of a single delta-peak at A = and a continuous 
part between A+ = (1 + \/0) 2 an( A A- = (1 — \/0) 2 - 



where m 1 = (m^), bb — {hi), a* = (a^) and q l = K 1 J2k=i( m k) 2 ■ The estimate of b k at 
the tth update is provided as b\ = sign(/i|.). Numerical experiments indicate that Eq. (fT2|) 
empirically converges by O(l) updates in most cases of large systems when the ratio cf^jo 2 
is sufficiently low. This implies that one can approximately perform the demodulation by 
serial computers in a time scale of 0(NK). Note that Eq. (JT3J) is simply an example of the 
dynamics, the fixed point of which agrees with the solution of the TAP equation in general, 
whereas several favorable properties hold in the specific case of p(A) = Pbasic(A) [28]. The 
quest for better algorithms of this sort is currently under way, as will be reported elsewhere. 

Example. - In order to address the significance of the developed approach, we consider 
a CDMA system in which the generation of sequences is devised for the purpose of enhancing 
the orthogonality. In this system, each s k is constructed so as to be orthogonal to all of the 
existing sequences s l7 S2, ■ ■ . , s k -i until k reaches N. Sequence generation of this sort becomes 
impossible when k exceeds N. Therefore, sjv+i is randomly generated and for N + 2 < 
k < 2N is constructed so as to be orthogonal to Sjv+i, sjv+2, ■ ■ ■ , ■ s fc-i without regard to the 
sequences of the previous group, Si, s 2 , . . . , sat. For k > 2N + 1, this procedure is repeated. 
Sequence generation of this sort was once considered with respect to the improvement of the 
learning performance of linear perceptrons [29]. For N = 2 L (L = 1,2, . . .), such generation 
is easily implemented by drawing a random gauge vector r g = (r^g) — {+1, — 1}^ for each 
group g{= 1,2,.. .) of size N and assigning the sequences of group g — [k/N\ + 1 as = 
(T^ik/N] £fj,A(k,N)) by utilizing the normalized Walsh-Hadamard basis e 1; e2, . . . , ejv [30]. Here, 
[u\ indicates the maximum integer that does not exceed u, and A(fc, iV) = k — N[k/N\ . The 
orthogonality perfectly cancels the crosstalk noise from other users of the identical group, 
which is advantageous for the improvement of communication performance. However, the 
orthogonality constraint yields strong dependence among sequences of an identical group, 
which prevents the scheme provided in [16] from accurately assessing the performance. 

On the other hand, our approach potentiates performance analysis by evaluating the eigen- 
value spectrum p(A) of R under the assumption of Eq. JlJ, which is expected to hold since 
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P = K/N E b /N [dB] 

Fig. 2 - (a) Bit error rate Pb vs. the load j3 = K/N under the condition of o"o — a — 0.37. 
The solid and broken lines indicate the theoretical prediction for the example system and the basic 
model, respectively. Because of the reduction of the crosstalk noise, a lower bit error rate can be 
achieved in the example system than that of the basic model for any load /3. In addition, the 
example system provides a larger value of the spinodal point than that of the basic model, which 
implies that the example system can deal with more users by computationally feasible algorithms 
than the basic model. The circles and diamonds represent the results obtained from 200 experiments 
utilizing variations of Eq. (|12|l for the example system and basic model of N = 2048, respectively, 
in which initial states were set to the matched filter output h° = Sfe • r following the conventional 
scheme [27,28]. These exhibit excellent agreement with theoretical curves, except around the spinodal 
points, where large fluctuations make it difficult for the algorithm to converge, (b) Bit error rate Pb vs. 
Eb/No — 101og 10 [l/(2<T 2 )], which is a conventional measure of the signal-to-noise ratio, for f3 = 1.1. 
Starting from the bottom of the figure, the three curves indicate the achievable limit (performance 
when the channel is accessed by only a single user), the theoretical predictions of the example system 
and the basic model, respectively. The circles and diamonds represent the numerical results obtained 
from 500 experiments on the basis of Eq. {12} for the example system, which exhibits excellent 
consistency with the theoretical prediction. 



the sequence generation statistically creates no directional preference. For this purpose, we 
fist evaluate another spectrum /5(A) of R = SAA T S T , which is dual to R and easier to 
handle. In CDMA systems, a set of users that communicate with a given base station gen- 
erally varies in time. Let us denote the set of user indices that remain in group g as fC(g) 
at the objective moment. We also introduce another notation j3 g = \IC(g)\/N, which implies 
that < f3 g < 1 Vg and j3 — J2 g Pg- Using these, the dual matrix can be expressed as 
R = R g , where R g — X)fceK:(g) ^-fc SfcS fc > ^ ne eigenvalue spectrum of which is provided as 
PgW = (1 — Pg)$W + -W -1 J2keic(g) ^(^ — ^Vl- We express the G-function of R g , which is 
given by p g (X) via Eq. |7|), as G g (x). Statistical independence across the groups guarantees 
that the G-function of R, G(x), is assessed as G(x) = J2 g Gg( x )- This provides the spectrum 
p(X) through Eq. ©, which yields the spectrum of R as p(X) = [1 - /3 _1 ]+^(A) + f3^ 1 p(X). 

As a simple but nontrivial example, we examined the case of (3 g = 1, j3— \_/3\ and for <?(> 0) 
of being less than, equal to and greater than [/3J +1, respectively, and Ak — 1 Vfc, which means 
p(X) = [1 - (3- 1 } + S(X) + (3- 1 ((1-/3+ L/3J )6(X -[£)) + (0 - L/3J )S(X - [(3\ - 1)) (Fig. [I]). 
Figure^] shows that the current system of the random orthogonal sequence generation outper- 
forms the basic model with respect to both the bit error rate and the position of the spinodal 
point, which practically determines the limitation of computationally feasible demodulation. 
Numerical experiments based on variations of Eq. p^]) . the results of which are plotted as 
symbols, exhibit excellent agreement with the theoretical predictions, which are denoted by 
the curves, indicating the significance of our approach. 
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Summary. - In summary, we have presented a novel approach by which to analyze the 
performance of CDMA communication systems. In the provided scheme, the properties of 
CDMA systems are characterized by the eigenvalue spectrum of the cross-correlation matrix 
composed of signature sequences. This enables us to accurately analyze a wide class of CDMA 
systems, even when signature sequences are dependent on each other. The significance of 
our approach has been demonstrated by application to a system that cannot be handled by 
the conventional scheme, the results of which showed excellent agreement with numerical 
experiments. 

Application to various cases and generalization to asynchronous communication will be 
examined in future studies. 
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